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DETAILED ACTION 

Response to Amendment 

1 . In response to the office action from 12/22/2008, the Applicant has submitted an 
amendment, field on 04/17/2009, amending Claims 1, 4, 6, 8, 10, 14, 35, 37 and 38, cancelling 
Claims 2, 3, 5, 7, 9, 11-13, 15-34, 36 and 39-44, and adding new claims 45-49. 

2. Applicant's arguments have been fully considered but are moot in view of the new 
ground(s) of rejection. 

Claim Objections 

3. Claim 37 is objected to under 37 CFR 1 .75(c), as being of improper dependent form for 
failing to further limit the subject matter of a previous claim. Applicant is required to cancel the 
claim(s), or amend the claim(s) to place the claim(s) in proper dependent form, or rewrite the 
claim(s) in independent form. More specifically, Claim 37 is an orphan claim and will not be 
examined since it depends from cancelled claim 36. 

Claim Rejections - 35 USC §103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

5. Claims 1, 4, 6, 8, 10, 14, 35, 38, 45-49 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Kuansan et al. (EP 1 255 194) in view of Gottfurcht et al. (U.S. Patent: 
7,020,845), hereinafter referred to as Kuansan and Gottfurcht. 

With respect to Claims 1, 35, 45, Kuansan discloses: 
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A method, machine -readable medium having instructions which when executed cause a machine 
to, and system comprising: 

interpreting user input received at a client mobile device from a user ( the object mode provides 
eventing and scripting and can offer greater functionality to give the dialog author a much finer 
client-side control over speech interactions, paragraph [0043 J) , the interpreting including 
identifying a selection of at least one of a plurality of web interaction modes (use of speech 
recognition in conjunction with at least a display, further this form of entry using both a screen 
display allowing free from selection of fields and voice recognition is called "multimodal, " 
paragraph [0045], Fig. 6), each of the plurality of web interaction modes to perform 
interpretation of content on a server computer system and a client mobile device coupled with 
the server computer system (voice recognition from audible signals transmitted by phone 80 are 
provided from voice browser 216 to recognition server 204, either through the network 205, or 
through a dedicated line 207, for example, using TCP/IP Web server 202, paragraph [003 5] ') L 
receiving, at the server computer system ( voice recognition from audible signals transmitted by 
phone 80 are provided from voice browser 216 to recognition server 204, either through the 
network 205, or through a dedicated line 207, for example, using TCP/IP Web server 202, 
paragraph [0035 1), a speech identifier of the identified focused display element recognizing 
speech associated with the user input based on evaluating a corresponding relationship between 
the display element and a speech element of the speech ( the event "onClick" is initiated which 
calls or executes function "talk" in script portion 272, further this action activates a grammar 
used for speech recognition that is associated with the type of data generally expected in field 
250, paragraph [0046]; telephone. Record (url, endSilence, [maxTimeout] , [initialTimeout] , 
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section 5.2.6, Appendix; "use of speech recognition in conjunction with at least a display, further 
this form of entry using both a screen display allowing free from selection of fields and voice 
recognition is called "multimodal, "paragraph [0045], Fig. 6.). 

Although Kuansan discloses how the event "onClick" is initiated which calls or executes 
function "talk" in script portion 272, further this action activates a grammar used for speech 
recognition that is associated with the type of data generally expected in field 250, (paragraph 
[0046]); telephone.Record (url, endSilence, [maxTimeout], [initialTimeout], (section 5.2.6, 
Appendix); and "use of speech recognition in conjunction with at least a display, further this 
form of entry using both a screen display allowing free from selection of fields and voice 
recognition is called "multimodal," (paragraph [0045], Fig. 6), Kuasan does not explicitly 
disclose the amended limitations the plurality of web interaction modes including a focus 
mechanism; identifying, via the focus mechanism, an active display clement associated with the 
user input, and focusing the client mobile device on the active display element receiving, at the 
server computer system . Gottfurcht, however, discloses the plurality of web interaction modes 
including a focus mechanism (" ...some embodiments of the invention will include speech to text 
(STT) capability 130 and speech recognition (SR) capablitiy 136... ", Col. 4, lines 19-43; "...If 
the identification has been received, the corresponding region is brought into focus ...desirable 
for web browsing. ..a first link in the focus region is highlighted... ", Col. 5, lines 17-47); 
identifying, via the focus mechanism, an active display element associated with the user input 
("...If the identification has been received, the corresponding region is brought into focus... ", 
Col. 5, lines 17-47), and focusing the client mobile device on the active display element 
(" ...node 12 might be a set top box and television, or an internet appliance, or a wireless device, 
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such as a web enabled cell phone... ", Col. 2, lines 25-41 " ...Remote control 504 may be 
equipped with a microphone for accepting voice commands... Link one is highlighted and A is 
enlarged, while the remaining regions are scaled ...a second link in region A is highlighted... ", 
Col. 5, line 59- Col. 6, line 23; " ...personal computer (PC) ...system employing... wide-area 
network (WAN) 10, such as the Internet, couples together a plurality of communication 
nodes... server nodes connected to WAN 10, such as server node 16 which may be any 
conventional web server... ", Col. 2, lines 20-41, Figs. 5A-5C). 

Kuansan and Gottfurcht are analogous art because they are from a similar field of 
endeavor in facilitating improved web accesses applications. Thus, it would have been obvious 
to a person of ordinary skill in the art, at the time of invention, to modify the teachings of 
Kuansan with the once received identification, having the corresponding region brought into 
focus. . .desirable for web browsing. . .a first link in the focus region is highlighted... taught by 
Gottfurcht in order to provide a simplified and easier navigation to facilitate usability access to 
services and at same time improved web access through a television display, internet appliance, 
and wireless devices, (Col. 1, lines 14-17, Col. 4, lines 60-65). 

With respect to Claims 4 and 38, Kuansan further discloses: 
wherein the focused display element comprises a hyperlink or a field in a form ( telephony voice 
browser 212 receives HTML pages/scripts or the like from web server 202, paragraph [0035]; 
the credit card information includes a field 250 for entry of the type of credit card being used, 
paragraph [0039]). 

Also, Gottfurcht discloses ". . .some embodiments of the invention will include speech to 
text (STT) capability 130 and speech recognition (SR) capablitiy 136...", (Col. 4, lines 19-43); 
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". . .If the identification has been received, the corresponding region is brought into 

focus. . .desirable for web browsing. . .a first link in the focus region is highlighted...", (Col. 5, 

lines 17-47). 

With respect to Claims 6 and 46, Kuansan further discloses: 

further including: extracting speech features from the user input, and generating a client 
mobile device request based in part on the extracted speech features (particular mode of entry, 
use of speech recognition with at least a display, further a screen display allowing free from 
selection of fields and voice recognition, paragraph [0045]). 

Also, Gottfurcht discloses ". . .node 12 might be a set top box and television, or an 
internet appliance, or a wireless device, such as a web enabled cell phone. . .", (Col. 2, lines 25- 
41); ". . .Remote control 504 may be equipped with a microphone for accepting voice 
commands... Link one is highlighted and A is enlarged, while the remaining regions are scaled 
...a second link in region A is highlighted. . .", (Col. 5, line 59- Col. 6, line 23); ". . .personal 
computer (PC). . .system employing. . .wide-area network (WAN) 10, such as the Internet, 
couples together a plurality of communication nodes. . .server nodes connected to WAN 10, such 
as server node 16 which may be any conventional web server. . .", (Col. 2, lines 20-41, Figs. 5A- 
5C). 

With respect to Claims 8 and 47, Kuansan further discloses: 

further including: receiving a session message at the server computer system to initialize 
a connection between the server computer system and the client mobile device, wherein the 
session message includes an internet protocol (IP) address of the client mobile device, a device 
type of the client mobile device, a voice character of a user responsible for the user input, a 
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language of the user input, and a default recognition accuracy requested by the client mobile 
device (the Recognition element can include a "mode" attribute to distinguish the following 
three modes of recognition, which instruct the recognition server 204 how and when to return 
the results, paragraph [0053]); various attribute of the Reco element control behavior of the 
recognition server 204, further the attribute "initial-Timeout" 289 is the time between the start 
of recognition 283 and the detection of speech 285, paragraph [0055] ; caller's IP address, 
(Apendix, Section 5.1 Properties); markup language page on the client device, ( paragraph 
[0034]); (input data indicative of speech, DTMF, handwriting, gestures or images obtained from 
the user, paragraph [0034]); instruction indicating a grammar to associate with the input data 
entered through the client device, paragraph [0035]); the return of results implies providing the 
"onReco" event or activating the "blind" elements as appropriate, further if the mode is 
unspecified, the default recognition mode can be "automatic", paragraph [0053]). 

With respect to Claims 10 and 48, Kuansan further discloses: 
further including: receiving a transmission message at the server to exchange 
transmission parameters between the server computer system and the client mobile device (usins 
wireless transceiver 52 or communication interface 60, speech data is transmitted to a remote 
recognition server 204, further recognition results are then returned to mobile device 30 for 
rendering, paragraph [0016]). 

Also Gottfurcht discloses ". . .the processor 100 will communicate thorugh the trsnaciever 
124 to the server using transmission control protocol/internet protocol (TCP/IP). Encryption and 
compression within the terminal may be handled by conventional hardware or software 
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solutions...", (Col. 4, lines 4-18); ". . .there are fifteen cells that represent navigation options and 
one messaging cell for displaying messages from the server, the progress bar or status bar. 
(Col. 8, lines 4-9). 

With respect to Claims 14 and 49, Kuansan further discloses: 

further including: receiving an exit message at_the server computer system to terminate a 
user session with the server computer system and the client mobile device (telephone. Hangup <() 
instruction terminating call in progress, section 5.2.4 Appendix). 

Also Gottfurcht discloses ". . .the processor 100 will communicate thorugh the trsnaciever 
124 to the server using transmission control protocol/internet protocol (TCP/IP). Encryption and 
compression within the terminal may be handled by conventional hardware or software 
solutions...", (Col. 4, lines 4-18); ". . .there are fifteen cells that represent navigation options and 
one messaging cell for displaying messages from the server, the progress bar or status bar. . .", 
(Col. 8, lines 4-9). 

Conclusion 

6. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
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the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Edgar Guerra-Erazo whose telephone number is (571) 270-3708. 
The examiner can normally be reached on M-F 7:30a.m.-5:00p.m. EST. If attempts to reach the 
examiner by telephone are unsuccessful, the examiner's supervisor, David Hudspeth can be 
reached on (571) 272-7843. The fax phone number for the organization where this application or 
proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you 
would like assistance from a USPTO Customer Service Representative or access to the 
automated information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Edgar Guerra-Erazo/ 
Examiner, Art Unit 2626 
/David R Hudspeth/ 

Supervisory Patent Examiner, Art Unit 2626 



